Establishing content validity of a survey research instrument : the older patients in acute care survey - United States

Geriatric nursing competency in the acute care setting is a social mandate for the 21st century. This article reports on the content validation of an Australian research instrument, the Older Patients in Acute Care Survey (OPACS) that examines the attitudes, the knowledge, and the practices of nurses working with acute care patients. The OPACS tool was developed primarily to assist nurse educators to assess attitudes, knowledge, and practices of nursing staff in caring for older patients in the acute care setting; to evaluate the implementation of institution-specific educational interventions; and to improve quality of care given to older patients. An overall content validity index (CVI) for the OPACS was calculated (CVI = .918), revealing high content validity. Opinions (CVI = .92) and practices (CVI = .97) subconstructs revealed high content validity as well. Therefore, results indicate that the OPACS has high content validity in the U.S. acute care setting and could assist nurse educators in establishing and enhancing nurse competency in the care for geriatric patients in the future.

Construct and content validity of the Greek version of the birth satisfaction scale (G-BSS).

Background: ‘Birth Satisfaction’ is a term that encompasses a woman’s evaluation of her birth experience. The term includes factors such as her appraisal of the quality of care she received, a personal assessment of how she coped, and her reconstructions of what happened on that particular day. Her accounts may be accurate or skewed, yet correspond with her reality of how events unfolded. Objective: To evaluate properties of an instrument designed to measure birth satisfaction in a Greek population of postnatal women. Study design: We assessed factor structure, internal consistency, divergent validity and known-groups discriminant validity of the 30-item Greek Birth Satisfaction Scale – Long Form (30-item G-BSS-LF) and its revised version the 10-item Greek-BSS-Revised (10-item-G-BSS-R), using survey data collected in Athens. Participants: A convenience sample of healthy Greek postnatal women (n = 162) aged 22–46 years who had delivered between 34 and 42 weeks’ gestation. Results: The 30-item-G-BSS-LF performed poorly in terms of factor structure. The short-form 10-item-G-BSS-R performed well in terms of measurement replication of the English equivalent version as a multidimensional instrument. The short-form 10-item-G-BSS-R comprises three subscales which measure distinct but correlated domains of: (1) quality of care provision (4 items), (2) women’s personal attributes (2 items), and (3) stress experienced during labour (4 items). Key conclusions: The 10-item-G-BSS-R is a valid and reliable multidimensional psychometric instrument for measuring birth satisfaction in Greek postnatal women.

Content validity of the Illness Perception Questionnaire-Revised for people with Type 2 Diabetes: A Think-Aloud study

Objectives: To access the cognitions of adults with type 2 diabetes whilst completing items on the Illness Perceptions Questionnaire – Revised (IPQ-R). To determine whether these cognitions are congruent with the meaning of items and subscales as interpreted by researchers and clinicians using the IPQ-R and to identify the nature and extent of problems that individuals experience when completing the IPQ-R.
Design: Participants (n=36) were recruited from a primary care diabetes clinic and a hospital diabetes clinic. They were asked to complete the IPQ-R using a ‘think-aloud’ methodology.
Main Outcome Measures: Transcripts were analysed to identify instances where participants expressed problems with item completion, or where there was inconsistency between verbal and written responses.
Results: The most problematic subscales were those of ‘personal control’ and ‘consequences’.
Conclusion: Generally, participants found the IPQ-R unproblematic. However, participants had problems with the concept of ‘cure’ and ‘symptoms’ in the context of type 2 diabetes, and with the negative phrasing used in some items. These findings have important implications for the interpretation of IPQ-R scores, particularly when the IPQ-R is used as the basis for individualised interventions among people with type 2 diabetes.

Content Validity in Landscape Valuation: A transdisciplinary approach to valuing the landscape of the peninsula of Sorrento, Italy.

This paper addresses the representation of landscape complexity in stated preferences research. It integrates landscape ecology and landscape economics and conducts the landscape analysis in a three-dimensional space to provide ecologically meaningful quantitative landscape indicators that are used as variables for the monetary valuation of landscape in a stated preferences study. Expected heterogeneity in taste intensity across respondents is addressed with a mixed logit model in Willingness to Pay space. The results suggest that the integration of landscape ecology metrics in a stated preferences model provides useful insights for valuing landscape and landscape changes

Face and content validity of smoking-related and matched control pictures

Smoking-related pictures and matched controls are useful tools in experimental tasks of attentional bias. Noteworthy the procedures used to produce and validate these pairs of pictures are poorly reported. This study aimed to describe the production and evidence of validity of a set of smoking-related pictures and their matched controls. Two studies were conducted to assess validity. An online internet-based survey was used to assess face validity of 12 pictures related to smoking behavior and 12 matched controls. All pictures were colored and were 95mm length x 130mm width. Participants were asked if the pictures were related or not to the smoking behavior and also rated how much each picture was related to smoking behavior. The second study investigated attentional bias in smokers (n = 47) and non-smokers (n = 50), and examined how they assessed all pictures in terms of pleasantness and the 12 smoking-related pictures in terms of relevance to their own smoking behavior. Craving was assessed before and after the experiment. Results indicate that this set of pictures are valid since smoking-related pictures were considered more related to smoking behavior compared to their matched controls. Moreover, smokers showed greater attentional bias for smoking-related pictures than non-smokers. Craving and relevance of the smoking-related pictures were higher in smokers than in non-smokers. Smokers considered smoking-related pictures them less unpleasant than non-smokers. These findings provide evidence of face and content validity of this set of pictures, which will be available to researchers, contributing to maximize the standardization of future investigations.

The content validity of the behaviour support plan quality evaluation tool (BSP-QEII) and its potential application in accommodation and day-support services for adults with intellectual disability

Background The quality of support provided to people with disability who show challenging behaviour could be influenced by the quality of the behaviour support plans (BSPs) on which staff rely for direction. This study investigated the content validity of the Behaviour Support Plan Quality Evaluation tool (BSP-QEII), originally developed to guide the development of BSPs for children in school settings, and evaluated its application for use in accommodation and day-support services for adults with intellectual disability.

Method A three-round Delphi study involving a purposive sample of experienced behaviour support practitioners (n = 30) was conducted over an 8-week period. The analyses included deductive content analysis and descriptive statistics.

Results The 12 quality domains of the BSP-QEII were affirmed as valid for application in adult accommodation and day-support service settings. Two additional quality domains were suggested, relating to the provision of detailed background on the client and the need for plans to reflect contemporary service philosophy. Furthermore, the results suggest that some issues previously identified in the literature as being important for inclusion in BSPs might not currently be a priority for practitioners. These included: the importance of specifying replacement or alternative behaviours to be taught, descriptions of teaching strategies to be used, reinforcers, and the specification of objective goals against which to evaluate the success of the intervention programme.

Conclusions The BSP-QEII provides a potentially useful framework to guide and evaluate the development of BSPs in services for adults with intellectual disability. Further research is warranted to investigate why practitioners are potentially giving greater attention to some areas of intervention practice than others, even where research has demonstrated these others areas of practice could be important to achieving quality outcomes.

Content validity of visual analog scales to assess symptom severity of acute angioedema attacks in adults with hereditary angioedema : an interview study

Background: Hereditary angioedema (HAE) is a rare, debilitating, potentially life-threatening condition characterized by recurrent acute attacks of edema of the skin, face/upper airway, and gastrointestinal and urogenital tracts. During a laryngeal attack, people with HAE may be at risk of suffocation, while other attacks are often associated with intense pain, disfigurement, disability, and/or vomiting. The intensity of some symptoms is known only to the person experiencing them. Thus, interview studies are needed to explore such experience and patient-reported outcome measures (PROMs) are required for systematic assessment of symptoms in the clinical setting and in clinical trials of treatments for acute HAE attacks.

Objective: The aim of this interview study was to assess the content validity and suitability of four visual analog scale (VAS) instruments for use in clinical studies. The VAS instruments were designed to assess symptoms at abdominal, oro-facial-pharyngeal-laryngeal, peripheral, and urogenital attack locations. This is the first known study to report qualitative data about the patient's experience of the rare disorder, HAE.

Methods: Semi-structured exploratory and cognitive debriefing interviews were conducted with 27 adults with a confirmed clinical/laboratory diagnosis of HAE (baseline plasma level of functional plasma protein C1 esterase inhibitor [C1INH] <50% of normal without evidence for acquired angioedema). There were 17 participants from the US and 10 from Italy, with mean age 42.5 (SD 14.5) years, range 18–72 years, mean HAE duration 21.3 (SD 14.1) years, range 1–45 years, 67% female, and 44% VAS-naïve. Experience of acute angioedema attacks was first explored, noting spontaneous mentions by participants of HAE symptomatology. Cognitive debriefing of the VAS instruments was undertaken to assess the suitability, comprehensibility, and relevance of the VAS items. Asymptomatic participants completed the VAS instruments relevant to their angioedema experience, reporting as if they were experiencing an acute angioedema attack at the time. Interviews were conducted in the clinic setting in the US and Italy over an 8-month period.

Results: Participants mentioned spontaneously almost all aspects of acute angioedema attacks covered by the four VAS instruments, thus providing strong support for inclusion of nearly all VAS items, with no important symptoms missing. Predominant symptoms found to be associated with acute angioedema attacks were edema and pain, and there was evidence of varying degrees of disruption to everyday activities supporting the inclusion of an overall severity item reflecting the disabling effects of HAE symptoms. VAS item wording was understood by participants.

Conclusion: This interview study explored and reported the patient experience of HAE attacks. It demonstrated the content validity of the four anatomical location HAE VAS instruments and their suitability for use in clinical trials of recombinant human C1INH (rhC1INH) treatment for ascertaining trial participants' assessments of the severity of acute angioedema symptoms.

The Responsiveness, Content Validity, and Convergent Validity of the Measure Yourself Concerns and Wellbeing (MYCaW) Patient-Reported Outcome Measure

Objective Measure Yourself Concerns and Wellbeing (MYCaW) is a patient-centred questionnaire that allows cancer patients to identify and quantify the severity of their ‘Concerns’ and Wellbeing, as opposed to using a pre-determined list. MYCaW administration is brief and aids in prioritising treatment approaches. Our goal was to assess the convergent validity and responsiveness of MYCaW scores over time, the generalisability of the existing qualitative coding framework in different complementary and integrative healthcare settings and content validity. Methods Baseline and 6-week follow-up data (n=82) from MYCaW and FACIT-SpEx questionnaires were collected for a service evaluation of the ‘Living Well With The Impact of Cancer’ course at Penny Brohn Cancer Care. MYCaW construct validity was determined using Spearman's Rank Correlation test, and responsiveness indices assessed score changes over time. The existing qualitative coding framework was reviewed using a new dataset (n=158) and coverage of concern categories compared to items of existing outcome measures. Results Good correlation between MYCaW and FACIT-SpEx score changes were achieved (r= -0.57, p≥0.01). MYCaW Profile and Concern scores were highly responsive to change: SRM=1.02 and 1.08; effect size=1.26 and 1.22. MYCaW change scores showed the anticipated gradient of change according to clinically relevant degrees of change. Categories including ‘Spirituality’, ‘weight change’ and ‘practical concerns’ were added to the coding framework to improve generalisability. Conclusions MYCaW scores were highly responsive to change, allowing personalized patient outcomes to be quantified; the qualitative coding framework is generalisable across different oncology settings and has broader coverage of patient-identified concerns compared with existing cancer-related patient-reported outcome measures.